Effects of an easy neuroanatomy book with schematics on student learning / Efectos de un libro sencillo de neuroanatomía con esquemas sobre el aprendizaje de los estudiantes

SUMMARY: Numerous students perceive neuroanatomy as a particularly difficult subject due to its overwhelming complexity. Therefore, a neuroanatomy book that concentrates on easy-to-read stories with schematics rather than exhaustive details has been published. This study evaluates the effect of a trial of the new neuroanatomy book on student learning. From the book, a printout on the brainstem and cranial nerve was extracted. Medical students read the printout, and subsequently were examined on their knowledge of and interest in neuroanatomy. Students who read the extract answered examination questions relatively well and were more interested in neuroanatomy. The printout seemed to enhance the knowledge and concentration of the students. After grasping the fundamental information in the book, students are expected to be able to learn advanced concepts comfortably and confidently. In addition, the book with its concise and simple content is suitable not only for short- duration neuroanatomy courses but also for self-learning.

Muchos estudiantes perciben la neuroanatomía como un tema particularmente difícil debido a su abrumadora complejidad. Por lo tanto, se ha publicado un libro de neuroanatomía que se concentra en historias fáciles de leer con esquemas en lugar de detalles exhaustivos. Este estudio evalúa el efecto de una prueba del nuevo libro de neuroanatomía en el aprendizaje de los estudiantes. Del libro, se extrajo una impresión sobre el tronco encefálico y los nervios craneales. Los estudiantes de medicina leyeron la copia impresa y, posteriormente, se les examinó su conocimiento e interés por la neuroanatomía. Los estudiantes que leyeron el extracto respondieron relativamente bien a las preguntas del examen y estaban más interesados en la neuroanatomía. La impresión parecía mejorar el conocimiento y la concentración de los estudiantes. Después de comprender la información fundamental del libro, se espera que los estudiantes puedan aprender conceptos avanzados con comodidad y confianza. Además, el libro con su contenido conciso y simple es adecuado no solo para cursos de neuroanatomía de corta duración, sino también, para el autoaprendizaje.

Análise da adequação dos itens do Teste de Progresso em medicina / Item analysis of Progress Test in medicine

Resumo: Introdução: A avaliação do estudante deve induzir aprendizagem e ser baseada em competência, ou seja, avaliar (habilidades cognitivas, psicomotoras e afetivas). Para avaliar conhecimento e a habilidade para sua utilização no contexto profissional, o Teste de Progresso (TP) tem sido usado em larga escala, com finalidade somativa e principalmente formativa. Objetivo: Este estudo teve como objetivo verificar a adequação e qualidade de itens que compõem os TP realizados pelos estudantes. Método: Trata-se de estudo exploratório descritivo e retrospectivo que analisou todos os itens de seis provas do TP aplicado a estudantes de Medicina do primeiro ao sexto ano da Faculdade de Medicina de Ribeirão Preto/USP, no período de 2013 a 2018. Os sete indicadores de boas práticas foram: 1. abordar tema relevante na formação médica; 2. ter enunciado maior que as alternativas; 3. avaliar aplicação do conhecimento; 4. definir pergunta clara para o item no enunciado; 5. avaliar apenas um domínio do conhecimento em cada item; 6. ter resposta correta e distratores homogêneos e plausíveis; 7. ausência de erros no item que acrescentam dificuldade desnecessária ou dão pistas da resposta correta. Dois avaliadores independentes analisaram as questões e, quando necessário, revisavam em conjunto os itens discordantes. Resultado: A análise das provas permitiu identificar boa qualidade técnica na maioria dos itens das seis provas, além de indicar que a não adesão foi mais frequente nos indicadores 4 e 5, que podem comprometer tanto a validade quanto a interpretação dos resultados da prova em termos de lacunas do conhecimento por parte dos estudantes. Conclusão: A qualidade das questões das provas analisadas é muito boa, mas foi possível identificar oportunidades de melhoria no processo de elaboração de itens, que servem de base para o desenvolvimento docente dos elaboradores da instituição.

Abstract: Introduction: Assessment drives learning and should follow a competence-based approach. The Progress Test (PT) has been used on a large scale for summative and mainly formative purposes to assess knowledge and the ability to use it in the professional context. Objective: To check the adequacy and quality of the items and that make up the progress tests sat by students. Method: Descriptive and retrospective exploratory study that analyzed all the items of six PT exams applied to medical students from the first to the sixth year of the Faculty of Medicine of Ribeirão Preto/USP, from 2013 to 2018. The seven indicators of good practices were: 1. Addresses a relevant topic in medical training; 2. Statement longer than key answer and distractors; 3. Application of knowledge evaluated; 4.Clear lead-in defined for the item in the statement; 5. Only one domain of knowledge assessed in each item; 6.Plausible and homogeneous key answer and distractors; 7.Absence of flaws that add unnecessary difficulty or give clues to the correct answer. Two independent evaluators analyzed the items and, if necessary, they jointly reviewed any disagreement. Result: The analysis showed a good technical quality of most items in the six PT exams. In addition, they indicated that non-adherence was a bit more frequent for indicators 4 and 5, which can compromise both the validity and the interpretation of the test results in terms of knowledge gaps on the part of students. Conclusion: In general, the quality of the items was very good but there are some opportunities for improvement in the process of item writing based on faculty development within the institution.

A educação física no ensino médio e os exames estandardizados: uma análise das questões do enem / La educación física en la enseñanza secundaria y los exámenes estandarizados: un análisis de las preguntas del enem / Physical education in high school and standardized exams: an analysis of the issues in enem

Resumo O artigo analisa as questões do novo Enem que apresentam objetos de conhecimento da Educação Física, compreendendo as relações que se estabelecem por e entre as áreas do conhecimento mediadas pelas competências e habilidades. De natureza qualitativa, utiliza a análise crítico-documental como metodologia. As fontes são compostas por: 49 questões relacionadas com a Educação Física no exame (2009 a 2017), as Diretrizes Nacionais para o Ensino Médio, o Documento Básico do Enem e a Matriz de Referência do Enem. Os usos e apropriações dos objetos de conhecimento da Educação Física, devido à sua natureza multidisciplinar, favorecem a exigência da elaboração das questões do exame visando à interdisciplinaridade por e entre as áreas do conhecimento, explorando as relações cotidianas dos sujeitos. A interação entre os objetivos da área de Linguagens e suas Tecnologias, promovida pelo exame, permite-nos compreender a Educação Física dentro de um contexto amplo de formação, para além do saberes de domínio.

Resumen El estudio analiza las preguntas del Nuevo Enem (Examen Nacional de la Enseñanza Media) que presentan objetos de conocimiento de la Educación Física, abarcando las relaciones que se establecen por y entre las áreas de conocimiento mediadas por competencias y habilidades. De naturaleza cualitativa, utiliza el análisis crítico-documental como metodología. Las fuentes están compuestas por: 49 preguntas relacionadas con la Educación Física en el examen (2009 a 2017), las Directrices Nacionales para la Enseñanza Media, el Documento Básico del Enem y la Matriz de Referencia del Enem. Los usos y apropiaciones de los objetos de conocimiento de la Educación Física, por su carácter multidisciplinario, favorecen la exigencia de elaborar las preguntas del examen buscando la interdisciplinariedad por y entre las áreas de conocimiento, explorando las relaciones cotidianas de los sujetos. La interacción entre los objetivos del área de Lenguas y sus Tecnologías, impulsada por el examen, nos permite comprender la Educación Física dentro de un amplio contexto de formación, más allá de los saberes del campo.

Abstract The article analyzes the issues that contain the Physical Education present in Novo Enem, understanding the relationships established by and between the areas of knowledge mediated by competences and abilities. Of the qualitative type, it uses documentary critical analysis as a methodology. The sources are composed of: 49 questions related to Physical Education in the exam (2009 to 2017), the National Guidelines for Secondary Education, the Basic Document of Enem and the Reference Matrix of Enem. The uses and appropriations of the contents of Physical Education, due to its multidisciplinary nature, favors the requirement to elaborate the exam questions aiming at interdisciplinarity by and between the areas of knowledge, exploring the subjects' daily relationships. The interaction between the objectives of the Languages, Codes and their Technologies area, promoted by the exam, allows us to understand Physical Education within a broad context of training, in addition to domain knowledge.

Mexican ENARM: performance comparison of public vs. private medical schools, geographic and socioeconomic regions / ENARM: comparación del desempeño de escuelas de medicina públicas y privadas, regiones geográficas y socioeconómicas

Abstract: Objectives: This study aimed to compare the performance in the National Assessment for Applicants for Medical Residency (ENARM in spanish) of private versus public medical schools, geographic regions and socioeconomic levels by using three different statistical methods (summary measurements, the rate of change and the area under the receiver operator characteristics [AUROC]). These methods have not been previously used for the ENARM; however, some variations of the summary measurements have been reported in some USA assessments of medical school graduates. Materials and methods: Cross-sectional study based on historical data (2001-2017). We use summary measures and colour-filled map. The statistical analysis included Mann-Whitney U, Kruskal-Wallis, Spearman correlation coefficient (Rs), and linear regression. Results: A total of 113 medical schools were included in our analysis; 60 were public and 53 private. We found difference in the median of total scores for type of schools, MD= 54.07 vs. MD= 57.36,p= 0.011. There were also significant differences among geographic and socioeconomic regions (p<0.05). Conclusions: Differences exist in the total scores and percentage of selected test-takers between type of schools, geographic and socioeconomic regions. Higher scores are prevalent in the Northeast and Norwest regions. Additional research is required to identify factors that contribute to these differences. Unsuspected differences in examination scores can be unveiled using summary measures.

Resumen: Objetivo: Comparar el desempeño en el Examen Nacional de Aspirantes a Residencias Médicas (ENARM) de escuelas de medicina privadas y públicas, regiones geográficas y niveles socioeconómicos mediante el uso de tres métodos estadísticos diferentes (medidas de resumen, tasa de cambio y el área bajo las características del operador receptor [AUROC en inglés]). Estos métodos no han sido utilizados previamente para el ENARM; sin embargo, se han informado algunas variaciones de las mediciones de resumen en algunas evaluaciones de graduados de medicina de Estados Unidos. Material y métodos: Estudio transversal basado en datos históricos (2001-2017). Se usaron medidas de resumen y un mapa lleno de color. El análisis estadístico incluyó Mann Whitney U, Kruskal-Wallis y coeficiente de correlación de Spearman (Rs). Resultados: Se incluyeron 113 escuelas de medicina en el análisis; 60 eran públicas y 53 privadas. Se encontraron diferencias en la mediana de las puntuaciones totales para el tipo de escuelas, MD= 54.07 vs. MD= 57.36,p= 0.011. También hubo diferencias significativas entre las regiones geográficas y socioeconómicas (p<0.05). Conclusiones: Existen diferencias en los puntajes totales y el porcentaje de examinados seleccionados entre el tipo de escuelas, regiones geográficas y socioeconómicas. Las puntuaciones más altas prevalecen en las regiones noreste y noroeste. Se requieren investigaciones adicionales para identificar los factores que contribuyen a estas diferencias. Las diferencias insospechadas en los puntajes de los exámenes se pueden revelar usando medidas de resumen.

Avaliação Somativa de Habilidades Cognitivas: Experiência Envolvendo Boas Práticas para a Elaboração de Testes de Múltipla Escolha e a Composição de Exames / Summative Assessment of Cognitive Skills: an Experience Involving Good Practices for Writing Multiple Choice Tests and Exam Composition

RESUMO As questões objetivas ou testes de múltipla escolha com somente uma alternativa correta constituem um dos métodos mais utilizados em todo o mundo em exames destinados a avaliar habilidades cognitivas, especialmente nas avaliações somativas. Provas que contêm predominantemente questões objetivas de múltipla escolha são utilizadas sobretudo nos exames em que muita coisa está em jogo, como concursos vestibulares, provas finais de cursos de graduação e exames próprios dos concursos de ingresso à residência médica ou de obtenção de título de especialista. Esta ampla difusão justifica-se pelo fato de os exames compostos com este tipo de questão preencherem mais completamente os requisitos de validade e de fidedignidade, além de terem vantagens quanto à viabilidade ou factibilidade, particularmente em provas com grande número de candidatos. No entanto, os requisitos de validade e fidedignidade, em especial, somente são preenchidos adequadamente quando se seguem normas próprias das boas práticas de construção de exames e de elaboração dos testes propriamente ditos. Neste artigo se descrevem algumas das boas práticas na elaboração de testes de múltipla escolha, baseadas em fontes da literatura nacional e internacional, bem como na experiência dos autores. Apresenta-se e se discute um conjunto de regras práticas para construir questões de múltipla escolha de boa qualidade no que se refere à forma e ao conteúdo e se comenta como compor tabelas de especificação. Este tipo particular de matriz da avaliação permite verificar o alinhamento entre os temas abordados na prova e os objetivos curriculares ou o que se espera que os estudantes/candidatos dominem, o que configura um importante indicador de validade. Apresenta-se também uma experiência bem-sucedida de trabalho em grupo na organização de exames que utilizam este tipo de questão, como exemplo de desenvolvimento de processo organizado para obtenção de questões de melhor qualidade, que também contribuiu para o desenvolvimento docente no campo de avaliação da aprendizagem.

ABSTRACT Objective items or multiple choice questions with just one correct answer are among the most widely used methods for cognitive skills assessment, especially in exams designed for summative purposes. Assessments related to the cognitive domain using multiple choice questions are mostly used in high-stake exams, i.e. where the risks of failing are associated with serious consequences for the candidates. The widespread use of objective items for assessing learning in the cognitive domain may be explained by the fact that this exam modality fulfills both validity and reliability requirements, with the additional advantage that they are practical for use in exams with large numbers of candidates. Nevertheless, the validity and reliability requirements, in particular, will only be properly fulfilled when the process of writing multiple choice questions follows the rules of good practices for constructing exams and writing tests. This manuscript describes some of the rules for developing high quality multiple choice tests, based on both national and international published sources, as well as on the author's experience. These rules relate to the content, language and presentation of the questions. This paper also addresses the importance of following appropriate rules for blueprinting construction, in order to show the alignment between assessment and curriculum and thereby contribute to meeting the validity requirements. It also briefly describes and discusses a successful experience of team work for constructing items and organizing exams. This experience exemplifies the combination of an organized process for constructing high quality questions for a well-balanced examination with an institutional strategy for faculty development in the field of learning assessment.

Evaluation of Residency Admission Exams / Avaliação de Questões de Prova de Concursos de Residência Médica

ABSTRACT Introduction: Residency admission exams, although not intended to evaluate medical training, do so in an indirect way. The evaluation of the quality of the medical residency tests allows, among other things, to re-evaluate the training process itself and the skills expected of the candidates. Objective: To evaluate first phase exam tests of different medical residency programs in the largest Brazilian urban centers. Method: We evaluated 500 questions of residency admission exams in the states of São Paulo, Rio de Janeiro and Minas Gerais. The items were evaluated in terms of their origin, geographical location, area of knowledge, contextualization, context scenarios and complexity by Bloom's taxonomy. Results: Most of the questions presented contextualization (64.4%, n = 322), with predominant scenarios of high complexity and in hospital environment. The predominant taxonomic category was identified as recognition (41.60%, n = 208), the second most frequent was judgment, in 26% of the questions (n = 130), followed by synthesis (15%, n = 75), analysis (7.60%, n = 38), comprehension (6%, n = 30) and application (3.8%, n = 19). Considering the dichotomization between questions of theoretical and clinical reasoning, we found a balance between both (clinical reasoning: 48.9%, n = 243; theoretical reasoning: 51.4%, n = 257). The association of contextualization with clinical reasoning was high, with the relative risk of an item requiring clinical reasoning in the presence of contextualization of 26.31 (CI 11.06 - 62.59). Final considerations: The scenario outlined by the present research demonstrates that the different selective processes for medical residency in Brazil differ greatly in relation to the selection profile, with hospital-centered focus, favoring scenarios of high complexity in a hospital environment. Although much has been done and discussed in order to promote changes in medical education in Brazil, the selection process for Medical Residency still fails to reflect the changes advocated since the end of the last century and consolidated in the public policies of the beginning of this century. If we consider that the selected professionals are likely to remain at that institution after the end of their undergraduate studies, then we can have some understanding of the feedback cycle that is created in the programs.

RESUMO Introdução: A prova de residência, apesar de não ter o objetivo de avaliar a formação médica, o faz indiretamente. A avaliação da qualidade das provas de residência médica permite, entre outras coisas, reavaliar o próprio processo de formação e as competências esperadas para os profissionais. Objetivo: Avaliar provas de primeira fase de diferentes programas de residência médica dos maiores centros urbanos brasileiros. Método: Foram avaliadas 500 questões de provas de residência dos estados de São Paulo, Rio de Janeiro e Minas Gerais. As questões foram avaliadas considerando sua origem, localização geográfica, área de conhecimento, contextualização, cenários do contexto e complexidade pela taxonomía de Bloom. Resultados: A maioria das questões apresentava contextualização (64,4%, n = 322), sendo os cenários predominantes de alta complexidade e em ambiente hospitalar. Identificou-se que a categoria taxonômica predominante foi o reconhecimento (41,60%, n = 208), sendo a segunda categoria mais frequente o julgamento em 26% das questões (n = 130), seguidas de síntese (15%, n = 75), análise (7,60%, n = 38), compreensão (6%, n = 30) e aplicação (3,8%, n = 19). Considerando a dicotomização entre questões de raciocínio teórico e clínico, encontramos uma situação de equilíbrio entre ambas (raciocínio clínico: 48,9%, n = 243; raciocínio teórico: 51,4%, n = 257). A associação de contextualização com raciocínio clínico foi alta, com risco relativo de uma questão solicitar raciocínio clínico na presença de contextualização de 26,31 (IC 11,06 - 62,59). Considerações finais: O quadro delineado pela presente pesquisa demonstra que os diferentes processos seletivos para residência médica no Brasil diferem muito entre si quanto ao perfil de seleção, com provas de caráter hospitalocêntrico, privilegiando cenários de alta complexidade em ambiente hospitalar. Embora muito se tenha feito e falado no sentido de promover mudanças na educação médica do Brasil, o processo seletivo para residência médica ainda não reflete as mudanças preconizadas desde o fim do século passado e consolidadas nas políticas públicas do início deste século. Se pensarmos que estamos selecionando profissionais que muito provavelmente se fixarão naquela instituição após o fim de sua pós-graduação, podemos ter uma ideia do círculo de retroalimentação que se cria nos programas.

Análisis de pruebas escritas bajo los principios de la evaluación auténtica: estudio comparativo entre carreras de la salud y otras carreras de dos universidades de la Región del Biobío / Written tests analysis under the principles of authentic assessment: a comparative study of written tests of medical and other undergraduate programs

Background: Learning assessment has great impact in students' achievement. However, it is one of the least intervened and researched areas in higher education institutions, all over the world. Aim: To compare the written tests applied to students of three health science undergraduate programs (Speech Therapy, Medical Technology and Nursing), with the written tests of three programs of other areas (Business and Administration, Psychology and Bioengineering). Material and Methods: Comparisons were done using the Authentic Assessment Model's indicators. Also, the magnitude of the change in these variables was evaluated in these two groups of undergraduate programs, after the participation of the teachers in a training program based on this model. A quantitative and repeated measurements design was used. Nineteen teachers participated (nine from medical sciences and 10 from other areas), who drafted 88 written tests before the intervention (which involved 1,318 items) and 93 written tests (that grouped 1,051 items) after it. Items were analyzed using a Hierarchical Lineal Model (HLM), controlling the tests' and the teachers' effects. Results: Both groups of undergraduate programs use multiple choice items with a higher frequency, although there were differences in the rest of the items. Also, HLM analysis showed that these programs differed in their changes after the intervention. Health science programs had less improvement in changing the kind of items used, but improved more in Authentic Assessment indicators. Conclusions: Written tests improved after an intervention aiming to improve the teachers' skills to prepare such tests.

The Relevance between Biological Nursing Subjects and Registered Nurse Licensure Examination Workbook in Republic of Korea and the United States of America

PURPOSE: This is a descriptive study to investigate the relevance between biological nursing science subjects (structure and function of the human body (SFHB), mechanism and effects of drugs (MED), clinical microbiology) and examination workbook items for Registered Nurse Licensure Examination (RNLE) in Republic of Korea (ROK) and the United States of America (USA). METHODS: RNLE 8 workbooks which were published by the Korean Nurses Association were utilized for analysis of Korean RNLE. Saunders comprehensive review for the NCLEX-RN® examination was used for analysis of US RNLE. The relevance between items in the standard syllabuses of biological nursing science subjects (SFHB, MED, clinical microbiology) and the RNLE items of these workbooks in ROK and the USA was analyzed. RESULTS: The relevance rates of ROK and the USA were 3.6% vs 0.4% in SFHB, 8.9% vs 23.0% in MED, and 4.5% vs 5.8% in clinical microbiology. CONCLUSION: In SFHB, the relevance of the RNLE in ROK was higher than that of the USA. However in MED the relevance of the RNLE in USA was higher than that of the ROK. Since medications are one of major tasks of nurses, it is necessary to increase the number of related items in the RNLE in ROK.

Preguntas de emparejamiento ampliado como herramienta de evaluación y recurso didáctico

Fundamento: la educación médica superior demanda la utilización de herramientas evaluativas y recursos didácticos que promuevan el razonamiento lógico de los educandos. En el manual sobre evaluaciones del National Board of Medical Examiners de Estados Unidos se dedica una sección a las preguntas de emparejamiento ampliado. En Cuba no hay información sobre el uso de estas preguntas en la docencia médica superior. Objetivo: describir las características de las preguntas de emparejamiento ampliado como herramienta evaluadora y recurso didáctico para el desarrollo del pensamiento lógico en estudiantes de Ciencias Médicas. Métodos: se realizó una revisión bibliográfica no sistemática, la variante narrativa, sobre las preguntas de emparejamiento ampliado en pre y posgrado de las Ciencias Médicas. Se realizó búsqueda en las bases de datos PubMed/Medline, PubMed Central y Google Académico con los descriptores extended matching question y extended matching ítem, así como preguntas de emparejamiento ampliado y de asociación ampliada en SciELO Cuba, SciELO Regional y en Redined, del Ministerio de Educación y Cultura de España. Desarrollo: se presenta la definición, estructura, requisitos, atributos y aplicaciones de esta modalidad de preguntas tipo test objetivo en las Ciencias Médicas. Existe consenso en su utilidad para la evaluación en disciplinas clínicas. Se emplea de manera amplia en diversos cuestionarios de las Ciencias Médicas, pre grado y posgrado, en países anglófonos. Se analizan las dificultades, entre ellas la poca o nula experiencia de los docentes y la complejidad y demanda de tiempo en su elaboración, y sus ventajas, que exigen y estimulan el razonamiento lógico en los educandos. Se enfatiza en el aseguramiento de la calidad de su diseño. Conclusiones: las preguntas de emparejamiento ampliado poseen atributos que apuntan a su utilidad como herramienta evaluativa y como recurso didáctico para promover el razonamiento lógico en los educandos en pre y posgrado de las Ciencias Médicas.

Background: higher medical education needs the utilization of assessment tools and didactical resources that promote logical reasoning in students. In the publication on assessment of the National Board of Medical Examiners of United States there is a whole section devoted to extended matching questions. There is no available information in Cuban scientific publications regarding the use of this modality in higher medical education. Objective: to describe the characteristics of extended matching questions as an assessment tool and a didactic resource to develop logical reasoning in medical sciences students. Methods: narrative review on extended matching questions in undergraduate and graduate medical education. A search was carried out in the data bases PubMed/Medline, PubMed Central and Google Academic using as descriptors extended matching question and extended matching item, and also with the same terms in Spanish in SciELO Cuba, SciELO Regional and in Redined, a data base of the Ministry of Education and Culture of Spain. Development: the definition, structure, requisites, attributes and applications of this modality of objective test questions in medical sciences are described. There is agreement in their usefulness for clinical subjects assessments. They are widely used in medical sciences education, undergraduate and graduate, in Anglophone countries. An analysis of their disadvantages and advantages is carried out. Among the first, the poor or null experience of faculty and the complexity and time demanded in their construction, and among the second, mainly that they require and promote logical reasoning of the students. Quality assurance in their design is emphasized. Conclusions: extended matching questions attributes point to their usefulness as an assessment tool and as a didactic resource to promote logical reasoning in medical sciences undergraduate and graduate students.

The Dental Hygienists' Perception of the National Practical Examination / 치위생과학회지

The purpose of the present study was to examine dental hygienists' perception of the current national practical examination. This research was performed using 199 self-reported surveys answered by professors of dental hygiene studies and clinical dental hygienist. Frequency analysis, chi-square tests, and analysis of variance were performed by using IBM SPSS Statistics ver. 20.0. The results revealed that many of the respondents consider the current national practical examination to be neutral. They did not think that the current national practical examination questions are useful for assessing occupation-centric integrated clinical practice ability and counseling techniques for patient intervention. The professors of dental hygiene studies believed that among the research tasks required as mentioned in the national practical examination questions, dental polishing and tooth brushing education are of paramount importance, whereas clinical dental hygienists believed that ultrasonic scaling is the most important (p<0.05). Most of the professors of dental hygiene studies reported that they conducted skills education for dental polishing and tooth brushing education, while most of the clinical dental hygienists reported that tasks actually performed in the clinic included impression taking, model fabrication, ultrasonic scaling, and explaining treatment precautions (p<0.05). Therefore, these tasks can be effectively carried out with the improvement of the national dental hygienist practical examination.

Valoración metodológica sobre la confección de exámenes finales de la carrera de Medicina en Cienfuegos / Methodological valuation on the elaboration of final exams in Cienfuegos medicine career

Fundamento: la calidad en la confección de los temarios de exámenes es un eslabón esencial en el sistema de evaluación en ciencias médicas. Objetivo: valorar metodológicamente los temarios de exámenes finales de las asignaturas propias de la carrera de Medicina en la Facultad de Ciencias Médicas de Cienfuegos. Método: se realizó una investigación observacional, descriptiva y transversal en los cursos 2012-2013 y 2013-2014, de la Facultad de Ciencias Médicas "Dr. Raúl Dorticós Torrado", en la que se incluyeron 29 asignaturas propias de la carrera de Medicina. Se utilizaron los métodos teóricos de análisis-síntesis e inducción-deducción, y la revisión documental (temarios de exámenes) como método empírico. Se revisaron dos temarios por asignatura, seleccionados al azar. Se contrastaron los objetivos y habilidades declarados en los programas con los contenidos de los exámenes. Resultados: el patrón más generalizado fue abordar un tema por pregunta, el formato más utilizado fue el de ensayo de respuestas cortas. En 49 temarios las raíces de las preguntas estaban correctamente elaboradas; en 30 de ellos la redacción de los ítems y formatos de las preguntas eran adecuadas y las escalas de calificación también. El error más frecuente fue la indicación de tareas imprecisas en preguntas de ensayo modificado. La mayoría de las interrogantes demandaban respuestas reproductivas. Conclusiones: de forma general, los temarios están confeccionados adecuadamente, aunque aún se observaron desaciertos en la elaboración de preguntas y escalas de calificación. El predominio de preguntas con respuestas reproductivas limita la validez conceptual.

Background: the quality in the elaboration of exam sets is an essential aspect in the assessment system in medical sciences. Objective: to value the final exam sets of the core subjects of the Medicine career in Cienfuegos Medical Sciences faculty according to methodology. Methods: it was carried out an observational, descriptive and cross-sectional investigation in the academic years 2012-2013 and 2013-2014, in "MD. Raúl Dorticós Torrado", Medical Sciences Faculty in which 29 core subjects of the Medicine career were included. Theoretical methods were used: analysis and synthesis and induction-deduction, and the documental review of exam sets was used as empiric method. Two exam sets were revised per subject, selected at random. The objectives and abilities declared in the syllabuses were contrasted with the contents of the exams. Results: the most widespread pattern was to approach a topic per question; the used format was that of short answers. In 49 exam sets the questions were correctly elaborated; in 30 of them the writing of the items and question formats were adequate and marking was also correct. The most frequent error was the indication of imprecise tasks in questions of modified trials. Most of the questions required a reproductive answer. Conclusions: in a general way, the exam sets were appropriately elaborated, even though, mistakes were observed in the elaboration of questions and marking. The prevalence of reproductive questions diminish the conceptual validity.

Valoración metodológica de temarios de exámenes finales de las carreras de Medicina, Estomatología y Enfermería / Methodological Evaluation of the Final Examinations of Medicine, Dentistry and Nursing

Fundamento: en la Universidad de Ciencias Médicas de Cienfuegos no existen estudios que aporten una visión general de los aciertos y desaciertos en la confección de temarios de exámenes, por lo cual se desconoce en qué medida se cumplen las recomendaciones para la elaboración de los temarios de exámenes finales. Objetivo: valorar aspectos metodológicos de temarios de exámenes finales de las carreras de Medicina, Estomatología y Enfermería. Métodos: se realizó un estudio descriptivo, en la Universidad de Ciencias Médicas de Cienfuegos, durante los cursos 2012/2013 y 2013/2014. Se revisaron 109 temarios de exámenes finales (a razón de dos por asignatura) de las carreras de Medicina, Estomatología y Enfermería, que sumaron 629 preguntas. Se revisaron los programas de las asignaturas, contrastándose objetivos y habilidades declaradas con los contenidos a evaluar. Resultados: el formato de pregunta más utilizado fue el ensayo modificado de respuestas cortas. De los 109 temarios, 88,9 % tuvo las raíces bien confeccionadas, 59,6 % los ítems bien elaborados y 61,6 % las escalas de calificación correctas. Los errores más frecuentes fueron: omisión del asunto o contenido en las raíces de las preguntas; tarea imprecisa en preguntas de ensayo modificado; y preguntas tipo complemento simple con tres opciones de respuestas. El 64,7 % de las preguntas fueron reproductivas. Conclusión: la mayoría de los temarios está confeccionada adecuadamente, pero se observaron dificultades en la elaboración de preguntas y escalas de calificación. El alto porcentaje de preguntas reproductivas se constató como una debilidad, al limitar la validez conceptual.

Background: there are no studies providing an overview of the strengths and weaknesses in the design of final examinations in the medical university of Cienfuegos; consequently, it is unknown to what extent the recommendations for constructing those exams are met. Objective: to evaluate methodological aspects of the final examinations of Medicine, Dentistry and Nursing. Methods: a descriptive study was conducted at the medical university of Cienfuegos during the 2012/2013 and 2013/2014 academic years. One hundred nine final exams (at a ratio of two per subject) of the Medicine, Dentistry and Nursing programs were reviewed, for a total of 629 questions. The syllabi were analyzed, contrasting the objectives and skills with the contents to be examined. Results: The most common question format was the modified essay question requiring short answers. Of the 109 exams, 88.9 % had well-constructed stems, 59.6% well-designed items and 61.6% correct rating scales. The most frequent errors were omission of the subject or content in the stem of the questions; imprecise task in modified essay questions; and multiple-choice questions with a simple alternative to be selected out of three. Sixty four point seven percent of the questions involved reproduction of knowledge. Conclusion: most of the exams are properly designed, but there are some difficulties in the construction of questions and rating scales. The high percentage of questions aimed at reproducing knowledge was regarded as a weakness since they limit the conceptual validity.